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Abstract. We present a thermodynamic formulation for scale-invariant systems 
based on the principle of extreme information. We create an analogy between 
these systems and the well-known thermodynamics of gases and fluids, and study 
as a compelling case the non-interacting system — the scale-free ideal gas — 
presenting some empirical evidences of electoral results, city population and 
total cites of Physics journals that confirm its existence. The empirical class 
of universality known as Zipf's law is derived from first principles: we show that 
this special class of power law can be understood as the density distribution of 
an equilibrium state of the scale-free ideal gas, whereas power laws of different 
exponent arise from equilibrium and non-equilibrium states. We also predict 
the appearance of the log-normal distribution as the equilibrium density of a 
harmonically constrained system, and finally derive an equivalent microscopic 
description of these systems. 
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1. Introduction 

The study of scale-invariant phenomena has unravelled interesting and somewhat 
unexpected behaviours in systems belonging to disciplines of different nature, from 
physical and biological to technological and social sciences [T]. Indeed, empirical 
data from percolation theory and nuclear multifragmentation [2] reflect scale-invariant 
behaviour, and so do the abundances of genes in various organisms and tissues [3], 
the frequency of words in natural languages [1], scientific collaboration networks [S], 
the Internet traffic [5] , Linux packages links , as well as electoral results [5j , urban 
agglomerations [5j and firm sizes all over the world [TD] . 

The common feature in these systems is the lack of a characteristic size, length 
or frequency for an observable k at study. This lack generally leads to a power law 
distribution p{k), valid in most of the domain of definition of k, 

p{k) ^ l/k^+\ (1) 

with 7 > 0. Special attention has been paid to the class of universality defined 
by 7 = 1, which corresponds to Zipf's law in the cumulative distribution or the 
rank-size distribution [2, 3, J H [3 H [TOl E]. Recently, Maillart et al. [7 have 
studied the evolution of the number of links to open source software projects in 
Linux packages, and have found that the link distribution follows Zipf's law as 
a consequence of stochastic proportional growth. In its simplest formulation, the 
stochastic proportional growth model, or namely the geometric Brownian motion, 
assumes the growth of an element of the system to be proportional to its size fc, and 
to be governed by a stochastic Wiener process. The class 7 = 1 emerges from the 
condition of stationarity, i.e., when the system reaches a dynamic equilibrium [llj . 

There is a variety of models arising in different fields that yield Zipf's law and 
other power laws on a case- by-case basis [9l [TTl [12]. In the context of complex 
networks, proportional growth processes known as preferential attachment [6] and 
competitive cluster growth TS] have been used to explain many of the properties 
of natural networks, from social to biological. The emergence of power laws in all 
these models is explained by W. J. Redd and B. D. Hughes ,14|, which have shown 
analytically that models based on stochastic processes with exponential growth — as 
the geometric Brownian motion, discrete multiplicative process, the birth-and-death 
process, or the Galton- Watson branching process — generate power laws in one of 
both tails of the statistical distributions. However, in spite of the success of these 
models, the intrinsic complexity involved makes the study at a macroscopic level 
difficult since a general formulation of the thermodynamics of scale-invariant physics 
is not established yet. 

Frieden et al. [15j have shown that equilibrium and non-equilibrium 
thermodynamics can be derived from the principle of extreme Fisher information. 
The information measure is done for the particular case of translation families^ 
i.e., distribution functions whose form does not change under translational 
transformations. In this case. Fisher measure becomes shift-invariant [16], what 
yields most of the canonical Hamiltonians of theoretical physics [17] . Variations of the 
information measure lead to a Schrodinger equation [18j for the probability amplitude, 
where the ground state describes equilibrium physics and the excited states account for 
non-equilibrium physics. As for Hamiltonian systems [TO], it has been recently shown 
that the principle of extreme physical information allows to describe the behaviour of 
complex systems, as the allometric or power laws found in biological sciences |20j . 
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In this work we present a theoretical framework based on the principle of extreme 
physical information that aims to describe scale-invariant systems at a macroscopic 
level. We show that the thermodynamics for such systems can be formulated when 
the information measure is taken on distributions that do not change under scale 
transformations. We show that proportional growth is intrinsic to this symmetry, and 
the processes that describe Zipf's law, as the geometrical Brownian motion, are the 
equivalent microscopic description of these systems. 

This work is organized as follows. In Sec. [2] we present the Fisher information 
measure for a scale-invariant system. In Sec.[3]we derive the equilibrium state and non- 
equilibrium states of the most general case of non-interacting scale-invariant system: 
the scale-free ideal gas (SFIG), and present some empirical evidences of its existence in 
electoral results and city population. In Sec.|4]we derive from first principles the special 
case of Zipf's law, what we call the Zipf regime of the SFIG, and study empirical data 
of the total number of cites of Physics journals to understand the conditions leading 
to its appearance. In Sec. [H] we constrain the system harmonically, finding that the 
equilibrium density follows a log-normal distribution. In Sec. |6] we derive from the 
SFIG the microscopic stochastic equation of motion, showing that the system can 
be described by geometrical Brownian walkers. Finally, in Sec. [7] we summarize our 
results and discuss some aspects of our work. In the Appendix we derive from the 
Fisher information the equations of the well-known translational- invariant ideal gas, 
which we use as analogy in the derivation of the SFIG. 

2. The principle of extreme information for a scale-invariant system 

The Fisher information measure / for a system of N elements, described by a set of 
coordinates q and physical parameters 9, has the form [17j 



where F{q\6) is the density distribution in configuration space (q) conditioned by the 
physical parameters (6). The constants Cij account for dimensionality, and take the 
form Cij — Cidij if qi and qj are uncorrelated. Following the principle of extreme 
information (PEI), the state of the system extremizes / subject to prior conditions, 
as the normalization of F or any constraint on the mean value of an observable (Ai). 
The PEI is then written as a variation problem of the form 



where /Xj are the Lagrange multipliers. In the Appendix, we derive from the PEI the 
density distribution in configuration space and the entropy equation of state for the 
well-known translational invariant ideal gas (IG) [H] . In analogy with this derivation, 
we follow here the same steps to obtain the SFIG density distributions and entropy 
equations of state. 

We consider a one-dimensional system with dynamical coordinates q = {k,v) 
where dk/dt = v. We define fc as a discrete variable, i.e. k = fci, ^2, . . . , kM, where 
ki ~ iAk and M, assumed to be large, is the total number of bins of width Afc. 
In order to address the scale-invariance behaviour of k in the Fisher formulation, we 




(2) 




(3) 
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change to the new coordinates u — Ink and w — du/dt, and assume that u and w are 
canonical 22J and uncorrelated. This assumption leads to the proportional growth 

dk/dt = v = kw. (4) 

For constant w this equation yields an exponential growth k = fcoe™*, which is a 
uniform linear motion for u: u = wt -\- uq, with uq = Inko 0. It is easy to check that 
the scale transformation k' = k/9k leaves invariant the coordinate w, whereas the 
coordinate u transforms translationally u' = u — Qk, where Qk = In^fc. 

If physics does not depend on scale, i.e., the system is translationally invariant 
with respect to the coordinates u and w, the distribution of physical elements can be 
described by the monoparametric translation families F{u, w\Qkj ©to) = fiu'-, w'). By 
analogy with the IG, we define the SFIG as a system of N non- interacting elements for 
which the density distribution can be factorized as f{u,w) — g{u)h{w). Taking into 
account that u and w are canonical and uncorrelated {cu = Ci ^ and Cuw = Cwu = 0), 
and that the Jacobian for the change of variables is dkdv = e^^dudw, the information 
measure I ~ lu + Iw can be obtained in the continuous limit as 

2 



lu^ Cu du e^"5(u) 



d\ng{u) 



I, 



dw h{w) 



du 
dlnhiw) 



dw 



(5) 



The constraints to the given observables (Ai) in the extremization problem 
determine the behaviour of the system. In the next sections we study three different 
cases: the general case of the scale-free ideal gas — the step-by-step analogy of the 
ideal gas — , a un-constrained gas or what we call the Zipf regime, and the harmonically 
constrained gas. 

3. The scale- free ideal gas 



For the general case, in the extremization of Fisher information we constrain the 
normalization of g{u) and h{w) to the total number of particles N and to 1, respectively 



du e2"c,(u) = N, 



dw h(w) — 1. 



(6) 



In addition, we penalize infinite values for w with a constraint on the variance of h(w) 
to a given measured value 



dw h{w){w — w)'^ 
he 

d In g 



where w is the average growth. The variation yields 

2 



du e'"5 



du 



H / du e2"5 ) = 



(7) 



(8) 



and 



5 I c,, 



dw h 



d\nh 
dw 



-\-\ dw h{w -wY + v dw h) =Q, (9) 



X This exponential growth allows to recognize the systems that we study in this work at the 
macroscopic level with those studied in |14| . 
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where fj,, A and v are Lagrange multipliers. Introducing g(u) — e 
varying ([5]) with respect to 5** leads to the Schrodinger equation 



-2u 



= 0, 



and 



(10) 



where — p^lcu- Analogously to the IG, we impose solutions compatible with a 
finite normalization of g in the thermodynamic limit iV, —> cx3 with N j D, ^ po 
finite, where — ln(/cA//fci) — In A/ is the volume in u space and po is defined as 
the bulk density. Solutions compatible with the normalization of ([6]) are given by 
^(u) = Aae~""/2, where Aa is the normalization constant and a — y/A + p' . In this 
general case, the density distribution as a function of k takes the form of a power law: 
gailTik) = A'^/k'^^". The equilibrium is defined by the ground state solution, which 
correspond the lowest allowed value a — 0. It can be show that it is just a uniform 
density distribution in u space at the bulk density: g{u)e'^'^du = N/fldu = pgdu. 

Introducing h{w) = <I>*(-u;)$(w) and varying ^ with respect to <&* leads to the 
quantum harmonic oscillator equation |18j 

\'{w 



w) + V 



(11) 



where A' = \/cw and v' — v/cw The equilibrium configuration corresponds to the 
ground state solution, which is now a Gaussian distribution. Using ([7]) to identify 
rj, we get the Boltzmann distribution 

exp [— (w — W)2/2ct^ "I 



|A'|-i/2 



h{w) 



27rCT„ 



(12) 



The density distribution in configuration space f{k,v)dkdv — f{u,w)e dudw is 



then 



f{k,v) 



N exp [~{v/k-W)^/2al 



nk^ 



27rCT„ 



(13) 



If we define H = A/c^/Ar as the elementary volume in phase space, where At is the 
time element, the total number of microstates is Z = N\H^ Yii^i fiiki^'^i)^ where 
/i = f/N is the monoparticular distribution function and A^! counts all possible 
permutations for distinguishable elements. The entropy equation of state S = —kIhZ 
reads 

fl •\/27rcr„, 3 1 
N H' ^21' 



(14) 



where k is a constant that accounts for dimensionality and H' = H/{kMki) = 
H/{MAk'^) = 1/(MAt). Remarkably, this expression has the same form as the one- 
dimensional IG (D = 1 in (IA.9|) ): instead of the thermodynamical variables (A^, V, T), 
here we deal with the variables (A^, D,,aw), which make the entropy scale-invariant. 

The total density distribution for k is obtained integrating for all v the density 
distribution in configuration space. Integrating (|13p we get 

A^ 1 



/(fc)= / dvfik,v) 



Po 



Qk k' 

which corresponds for large A^ to an exponential rank-size distribution 

1' 



fc(r) = fci exp 



Po 



(15) 



(16) 
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Figure 1. (colour on-line) a, rank-size distribution of the cities of the province 
of Huelva, Spain (2008), sorted from largest to smallest, compared with the result 
of a simulation with Brownian walkers (green squares), b, rank-plot of the 2008 
General Elections results in Spain, c, rank-plot of the 2005 General Elections 
results in the United Kingdom, (red dots: empirical data; blue lines: linear 
fitting) . 



where r is the rank. 

This behaviour, which corresponds to the class of universahty 7 — in ([T]), 
has been empiricaUy found by Costa Filho et al. [8] in the distribution of votes in the 
Brazihan electoral results. We have found such a behaviour in the city-size distribution 
of small regions and electoral results, like the province of Huelva (Spain) [23], and the 
2008 Spanish General Elections results respectively. We show in figure la and lb 
their rank-size distribution in semi-logarithmic scale, where a straight line corresponds 
to a distribution of type (fT6|) . Most of the distribution can be linearly fitted, with a 
correlation coefficient of 0.994 and 0.998 respectively. From these fits we have obtain a 
bulk density of po = 0.058 for the General Elections results, and in the case of Huelva 
po = 17.1 (A^ = 77, = 4.5). Using historical data for the latter [23], we have used 
the backward differentiation formula to calculate the relative growth rate of the i-th 
city as 

, , (2008) _ , , (2007) 

m = '-^ ^ (17) 

where k^'^^^'^^ and fcp*^"*) are the number of inhabitants of the i-th city in 2007 and 
2008 respectively and At — 1 year. We have obtained W = 0.012 years"""^ and 
(7^ = 0.032 ycars^^. However, the regularities are not always obvious, as shown 
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for the most voted parties in Spain'08 or the whole distribution of the 2005 General 
Elections results in the United Kingdom [5S] (figure Ic). In both cases, the competition 
between parties seems to play an important role, and the assumption of non-interacting 
elements can be unrealistic m. 



4. The Zipf regime 



In the previous subsection we considered that N/Q remains finite even in the 
thermodynamic limit, i.e., the system reaches the bulk density pq. However, if 
N/fl — > as cxD, i.e., the system is exposed to an empty infinite volume, the 

normalization can not be achieved and the constraint has to be removed (/i = 0). We 
call this case the Zipf regime, in order to distinguish it from the general. 

Considering only the k coordinate in the domain [ki, oo), the information measure 
for the total density distribution f{k)dk — /(u)e"du = p{u)du, reads 

2 



c„ / du e"/(u) 



d\nf{u) 



du 



and the extremization problem 
J c„ / dw e"/ 



a In/ 



du 



0. 



(18) 



(19) 



Introducing f{u) — e 
Schrodinger equation 

4^ 
du- 



'5'*(w)^'(m), and varying with respect to 4"* leads to the 
*(w) = 0. (20) 



1 



Taking the boundary conditions lim„^oo fi^) = and f{ui) — C where ui = 
C is a constant, the solution to the equation is ^'(u) = C'e^"/^, where C 
It can be shown that this is just an exponential decay in u space /(u)e"du = 
This solution leads to the total density distribution 

m ^ ^ 

with = Nki for a normalized density. It corresponds in the continuous limit to a 
rank-size distribution of the type 

Nki 



Inki and 
= %/Z7c"i . 
Ce~"du. 



(21) 



k{r) 



(22) 



which is the Zipf's law (universal class 7 = 1) of [SlElllllSllIlElIIOllIT]. This result 
is remarkable: for the first time Zipf's law is derived from first principles. 

In figure 2 we show the known behaviour [11] of the rank size distribution of the 
top 100 largest cities of the United States [27], which shows an slope near —1 (7=1) 
in the logarithmic representation of the rank-plot. 

The appearance of the bulk and the Zipf regime in a SFIG can be understood 
studying empirical data. We have studied the system formed by all Physics 
journals [28] {N = 310) using their total number of cites as coordinate k. If a journal 
receives more cites due to its popularity, it becomes even more popular and therefore it 

§ The effects of interaction are studied in 26;, where we go beyond the non-interacting system using 
a microscopic description based on complex networks. 
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Figure 2. (colour on-line) Rank-plot of the 100 largest cities of the United States. 



will receive more cites. Under such conditions proportional growth and scale invariance 
are expected. Since we consider all fields of Physics, correlation effects are much lower 
than only consider journals of an specific field, so the non-interacting approximation 
seems realistic in this case. In figure 3 we show the rank-plot of the number of cites 
of Physic journals, where we have found a slope near —1 for the most-cited journals 
in the logarithmic representation (figure 3a) and an slope near -1-1 for the less-cited 
journals (figure 3b). For the central part of the distribution bulk density reaches a 
value of pq ~ 57 (figure 3c). 

This distribution shows an extraordinary symmetric behaviour under the change 
k 1/k {u ^ —u). We show in figure 4 the raw empirical data compared with 
the distribution obtained from the transformation k' — c/k {u' = —u -\- Inc), where 
c = 3.3 X 10^. The symmetry of this system is an important clue to understand both 
regimes, and represents a perfect example of the conditions needed to observe bulk 
and Zipf regimes in a non-interacting scale-invariant system. The main part of the 
density distribution reaches the bulk density obeying ()15|) . whereas Zipf's law emerge 
at the edges, obeying (pij) : following the analogy with the physics of gases and fluids, 
we can think of the system as a drop, where the Zipf regime is the sign of a surface 
since it reproduces how the density exponentially falls from the bulk density to zero 
in u space when the system is exposed to an infinite empty volume. This effect is 
clearly visible in figure 5, where the empirical density distribution p{u)du in u space 
is compared with the fitted density 



where pa = 0.1, po = 57, pb = 4.3 x 10^, Ua = 5.2 and Ub = 10. These findings lead 
us to conclude that the system of Physics journals sorted by total number of cites is 
a perfect example of the scale-free ideal gas at equilibrium. 

5. The harmonically constrained system 

We now consider a system with a constraint in a given observable {A) which locally 
depends on fc, ^ = A{k). The second order Taylor expansion with respect to u = In/c 
near a minimum is written as A{u) — ^(e") ~ ylg + A2/2{u — Um)^, where Aq, A2 




ii u < Ua 

a Ua < U < Ub 

ii Ub > u 



(23) 
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Figure 3. (colour on-line) a, rank-plot of the total number of cites of physics 
journal, from most-cited to less-cited, in logarithm scale, b, sorted from less-cited 
to most cited c, same as a, in semi-logarithm scale. (red dots: empirical data; blue 
line: linear fitting). 
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Figure 4. (colour online) Rank-plot of the total number of cites of Physics 
journal, from most-cited to less-cited, compared with the distribution obtained 
from the inverse transformation k' = 3.3 X where k is the number of cites. 



and constants. Introducing this constraint and the normahzation condition to 

the number of elements N of the total density distribution, the extremization problem 
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Figure 5. (colour online) Empirical density distribution in u space of the total 
number of cites of Physics journals, compared with II23I I. The bulk regime and 
the Zipf regime at the edges is clearly visible. 



reads 




9 In/ 



+ fi du e"/ 



du 



Aq + -A2{U - 



= 



Introducing f{u) — e "5'*(m)\E'(u), and varying with respect to 
quantum harmonic oscillator equation 



(24) 



leads to the 



'4— + A'(m-mo) 



*(it) = 0, 



(25) 



where now we have defined A' = {XA2)/2cw and i^' = {ly + 1 + AAo)/c„. The ground 
state solution is a gaussian distribution, which now yields a total density distribution 
of the form of a log-normal distribution 

N /-(lnfc-M,„^2^ 



/(fc) = 



■ exp 



(26) 

0, the constraint can be also 



with I A' I -1/2 = 0-2 ^ _ j^Q^-g ^1^^^ if 
understood as a constraint in the variance of u. 

The log-normal distribution has been widely observed in a large number of scale- 
invariant systems [55] • In [33 S. Fortunato and C. Castellano found this behaviour 
in the electoral results of different countries and for different years. We can think of 
this constraint as the effect of polices or social factors: low popularity candidates 
are penalized since the party does not present them for the elections, and high 
popularity candidates are penalized by the competition in campaign. Both effects 
can be approximated to second order as a harmonic potential, however anharmonic 
effects are expected in a high order study. 

Defining H" = 1/At and km — lnu„i being km — mAk, the entropy equation of 
state reads in this case 



NH" 



(27) 



which maintains scale invariance. 
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6. The microscopic description 

The dynamics of the system can be microscopically described as a stochastic process 
using ([4]) and the density distribution (fT2| . Treating zz; as a random variable, the 
stochastic equation of motion is written as a geometrical Brownian motion 

dfc = kwdt + ka^dW, (28) 

where dW is a Wiener process. In the u space, this equation reads 

du = wdt + a.u,dW, (29) 

which describes the well-known Brownian motion. (j28p exactly describes the dynamical 
condition found empirically in [7] and also the stochastic proportional growth model 
used in [TTj to obtain Zipf's law. We can think of this sort of simulations as the 
equivalent of molecular dynamics simulations for gases and liquids 31j. 

Effectively, (|29p implies that a uniform density in u space of N Brownian walkers 
moving in a fixed volume Q — a model used in the literature to describe the IG [31j — 
describes the SFIG when we represent the system with the coordinates {k,v). In 
figure la we show the rank-plot for a system of = 78 geometrical Brownian walkers 
with (7„ = 0.029 in a volume of = 4.5 and ki = 200 in reduced units, which nearly 
describes the distribution of the population of the province of Huelva. 

7. Summary and Discussion 

We have shown that a thermodynamic description of scale-invariant systems can be 
formulated from the principle of extreme information, finding an analogy with the 
thermodynamics of gases and fluids. We have derived the density distribution in 
configuration space and the entropy equation of state of the scale-free ideal gas in 
the thermodynamic limit, and have found empirical evidences of its existence in city 
population, electoral results and cites to Physics journals. In this context, Zipf's law 
emerges naturally as the equilibrium density of the non-interacting system when the 
volume grows to infinity, what we call the Zipf regime. Using empirical data we have 
seen that this regime can be understood as the density fall of a surface between the 
bulk and an empty volume. We have also studied the effect of a harmonic constraint, 
finding that in this case the density of the system follows a log-normal distribution, 
which has been empirically observed in electoral results and in many other scale- 
invariant systems Finally we have shown with a simulation of city population 
that a geometrical Brownian motion can describe the system at a microscopic level. 

It is well known that in real gases the most interesting situations emerge 
when interactions between particles become relevant, originating deviations from the 
equation of state of the IG, and making room for the appearance of, e.g., phase 
transitions [H] . Analogously, one should also expect this rich phenomenology to show 
up in scale-invariant real systems, which may explain deviations from Zipf's law in 
empirical distributions. A study beyond the ideal gas is in progress, and further results 
will be reported ^5] . 
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Appendix A. The translational invariant ideal gas 

In this appendix we derive from the principle of extreme information the density 
distribution in configuration space and the entropy equation of state of the 
translational invariant ideal gas (IG) [H]. The IG model describes non-interacting 
classical particles of mass m with coordinates q — {r,p), where mdr/d< = p. We 
assume that these coordinates are canonical [22] and uncorrelated. This assumption 
is introduced in the information measure ^ as = CiSij, where q = for space 
coordinates, Ci = Cp for momentum coordinates, and S^j is the Kronecker delta. The 
density distribution can be factorized as ,f(r,p) = p(r)ri{p), and the information 
measure I = Ir + Ip reads, if D is the dimension of the space 



Ir= Cr j d'^r p{r)\Vr\np[rf 
Ip^ Cp j d°p ri{p)\\/p\nri{p)Y 



(A.l) 



In the extremization of Fisher information we constrain the normalization of p{r) 
and rjijp) to the total number of particles A'" and to 1, respectively 

j d^r p{r) ^N, J d^p Tj{p) = 1. (A.2) 

In addition, we penalize infinite values for the particle momentum with a constraint 
on the variance of ri{p) to a given measured value 

j d^pf^{p){p-pf ^Dal, (A.3) 

where p is the mean value of p. For each degree of freedom it is known from the Virial 
theorem that the variance is related to the temperature T as = mkBT, being ks 
the Boltzmann factor. The variation yields 



jjc^y" d^r p|Vrlnp|' 



H d^r p\^0 (A.4) 



and 



^jcp^ d^p77|Vpln77|' + A J d^pT]{p-pf + v j d^pr^ = 0, (A.5) 

where /z, A and u are Lagrange multipliers. 

Introducing p{r) = 5'*(r)^'(r) and varying (|A.4p with respect to ^E"* leads to the 
Schrodinger equation [18 

[-4V2 + ^'] *(r) = 0, (A.6) 

where fi' = fj./cr. To fix the boundary conditions, we first assume that the N 
particles are confined in a box of volume V, and next we take the thermodynamic limit 
(TL) N,V ^ oo with N/V finite. The equilibrium state compatible with this limit 
corresponds to the ground state solution, which is the uniform density p{r) — N/V. 

Introducing ri{p) — $*(p)$(p) and varying (jA.Sp with respect to $* leads to the 
quantum harmonic oscillator equation [18 

[-4V2 + A'(p-p)2 + j.']$(p) = 0, (A.7) 

where A' — X/cp and v' ~ v/cp. The equilibrium configuration corresponds to the 
ground state solution, which is now a gaussian distribution. Using (IA.3|) to identify 
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I 1 -1/2 _ ^2 gg-(- ^YiQ Boltznianii distribution, which leads to a density distribution 
in configuration space of the form 

If H is the elementary volume in phase space, the total number of microstates is 
Z = N\H^^ YiiLi fi{'''iiPi): where /i = f/N is the monoparticular distribution 
and A^! counts all possible permutations for distinguishable particles. The entropy 
5* = — fcs InZ is written as 

{V ( 27ral \"^^ 2 + d\ 

where we have used the Stirling approximation for Nl. This expression is in exact 
accordance with the known value of the entropy for the IG ^21) , which shows the pre- 
dictive power of the Fisher formulation. 
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